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TITLE OF THE INVENTION 
COORDINATE INPUT APPARATUS AND CONTROL METHOD THEREOF, 
COORDINATE INPUT POINTING TOOL, AND PROGRAM 

5 FIELD OF THE INVENTION 

The present invention relates to a coordinate 
input apparatus which calculates the position 
coordinates of a coordinate input pointing tool with 
respect to a coordinate input surface, a control method 
10 of the coordinate input apparatus, a coordinate input 
pointing tool, and a program. 

BACKGROUND OF THE INVENTION 

Conventionally, apparatuses which can realize a 

15 paper-pencil relationship are known, in which a 
coordinate input apparatus capable of inputting 
coordinates is placed on the display screen of a 
display apparatus such as a CRT display, a liquid 
crystal display (LCD), or a projector so that 

20 operator's pointing or handscript by a pointing tool is 
displayed on the display apparatus. 

There are coordinate input apparatuses of a type 
that uses a transparent input plate, including a 
resistive film type, an electrostatic type, and an 

25 ultrasonic wave type which propagates an ultrasonic 

wave to a coordinate input surface made of glass or the 
like. Some coordinate input apparatuses are of an 
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optical type or type which detects a position by 
radiating a sonic wave Into the air. In some 
coordinate Input apparatuses of an electromagnetic 
Induction ( electromagnetic transmitting/receiving ) 
5 type, a mechanism for calculating coordinates Is placed 
behind a display apparatus while a transparent 
protective plate Is placed In front of the display 
apparatus, thereby constructing an Input/output 
Integrated Information device. 

10 Such Information devices have been used for 

electronic notepads at first . Along with an Increase 
In the size of display apparatuses. Information devices 
such as a relatively large pen Input computer are also 
becoming popular. Such Information devices are 

15 combined with wide- screen display apparatuses such as 

front projectors, rear projectors, or PDPs and used as, 
e.g., presentation apparatuses or video conference 
systems. For display apparatuses such as wide-screen 
liquid crystal displays or PDF displays. Image quality 

20 Improvement and cost reduction are still progressing. 

As satellite broadcasting and the like are switching to 
digital broadcasting systems, the specifications and 
forms of TV sets are also entering a transitory stage. 
These wide -screen display apparatuses are 

25 replacing, e.g., whiteboards or electronic blackboards 
used in offices and are used at meetings or briefings 
by displaying material data that are prepared in 
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personal computers In advance on the wide -screen 
display apparatuses. In this case. Information 
displayed on the wide- screen display apparatus can be 
updated by an operator or a person present by directly 
5 touching the screen like a whiteboard so that, e.g., 
the display contents on the display screen can be 
switched by controlling the personal computer. 

However, large-scale input /output Integrated 
systems of this type have the following problems. 

10 When a briefing assuming many participants or use 

environment through a network is taken into 
consideration, it is more preferable that, e.g., a 
questioner be able to operate the screen from his/her 
position by remote control or obtain information from 

15 the network from his/her position, as needed, in 

addition to control of a personal computer by causing 
an operator to directly touch the screen. 

When a conventional apparatus of this type is 
used to perform input (remote control) from a position 

20 spaced apart from the screen, a relative coordinate 
scheme is used, in which the cursor moving cunount is 
calculated on the basis of the differential value from 
the preceding coordinates, like a mouse that operates a 
computer . 

25 Hence, the operator checks the current cursor 

position displayed on the screen, moves the cursor from 
that position to a desired position, and further moves 



the cursor while drawing a graphic pattern or the like. 

More specifically, if the system turns on/off a 
signal to be transmitted to the coordinate input 
apparatus main body by pressing a button on a 
5 coordinate input pointing tool, the drawing operation 
is performed by repeating cursor movement, drawing 
(cursor movement), stop, cursor movement, and drawing 
(cursor movement) by turning on/off the switch. 

However, the stroke amount by operation (by 

10 moving the hand) and the cursor moving €unount are in a 
1 : 1 correspondence (i.e., when the input device is 
moved by 10 cm, the cursor on the screen also moves by 
10 cm) even when ten input position is far apart from 
the screen. When the operator wants to input a stroke 

15 long relatively to the screen, i.e., when the operator 
wants to perform one stroke operation without 
transmission stop operation, he/she needs to do a large 
action although the screen size seems to be relatively 
small for him/her because of the distance between the 

20 screen and the input position, resulting in 
considerable difficulty in input operation. 

In some systems , the cursor displayed on the 
screen is moved by operating cursor keys. Such a 
system is excellent in operability for cursor movement. 

25 However, it is not always suitable in drawing a 
character or graphic pattern. 
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SUMMARY OF THE INVENTION 
The present invention has been made in 
consideration of the above situation « and has as its 
object to provide a coordinate input apparatus which 
5 can efficiently and appropriately input coordinates in 
each of a plurality of input states, a control method 
of the coordinate input apparatus , a coordinate input 
pointing tool, and a program. 

According to the present invention, the foregoing 
10 object is attained by providing a coordinate input 

apparatus which calculates position coordinates of a 
coordinate input pointing tool with respect to a 
coordinate input surface, comprising: 

calculation means for calculating the position 
15 coordinates of the coordinate input pointing tool; 
change means for changing the position 
coordinates on the basis of predetermined coordinates 
related to a distance between the coordinate input 
surface and the coordinate input pointing tool; and 
20 output means for outputtlng the position 

coordinates changed by the change means . 

In a preferred embodiment, the change means 
changes the position coordinates by multiplying the 
position coordinate values by a predetermined 
25 coefficient on the basis of the coordinates related to 
the distance between the coordinate input surface and 
the coordinate input pointing tool. 
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In a preferred embodiment, the apparatus further 
comprises Interpolation means for Interpolating the 
position coordinates changed by the change means. 

In a preferred embodiment, the coordinate Input 
5 pointing tool further comprises ultrasonic wave 

generation means for generating an ultrasonic wave to 
input a position to the coordinate input surface. 

According to the present invention, the foregoing 
object is attained by providing a coordinate input 
10 apparatus which calculates position coordinates of a 
coordinate input pointing tool with respect to a 
coordinate input surface on which an X-Y plane and a 
Z-axls with respect to the X-Y plane are defined, 
comprising: 

15 calculation means for calculating the position 

coordinates (X,Y,Z) of the coordinate input pointing 
tool; 

determination means for determining an operative 
state of a predetermined switch of the coordinate input 
20 pointing tool; 

comparison means for comparing a predetermined 
value with a Z- coordinate value of the (X,Y,Z) 
coordinate values calculated by the calculation means, 
on the basis of a determination result of the 
25 determination means; and 

control means for controlling output of the 
position coordinates {X,Y,Z) calculated by the 
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calculation means, on the basis of the determination 
result of the determination means or the determination 
result of the determination means and a comparison 
result of the comparison means . 
5 In a preferred embodiment, the control means 

determines a coordinate output form of the position 
coordinates (X,Y,Z) calculated by the calculation 
means, on the basis of the determination result of the 
determination means or the determination result of the 

10 determination means and the comparison result of the 
comparison means. 

In a preferred embodiment, the coordinate output 
form Includes 

a first coordinate output form In which at least 

15 (X,Y) coordinate values of the position coordinates 

(X,Y,Z) calculated by the calculation means are output, 
and 

a second coordinate output form In which 
differential coordinate values (X,Y,Z) as differences 

20 between predetermined position coordinates calculated 
by the calculation means and position coordinates 
(X,Y,Z) calculated by the calculation means later as 
the coordinate input pointing tool moves are output. 
In a preferred embodiment, the control means 

25 determines a presence/absence of the output of the 

position coordinates on the basis of the determination 
result of the determination means or the determination 
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result of the determination means and the comparison 
result of the comparison means. 

In a preferred embodiment, when the determination 
result of the determination means indicates that the 
5 predetermined sv/itch is in the operative state, the 

control means outputs at least (X,Y) coordinate values 
of the position coordinates (X,Y,Z) calculated by the 
calculation means. 

In a preferred embodiment, when the determination 
10 result of the determination means indicates that the 

predetermined switch is not in the operative state, and 
the comparison result of the comparison means indicates 
that the Z- coordinate value is not more than the 
predetermined value, the control means outputs at least 
15 (X,Y) coordinate values of the position coordinates 
(X,Y,Z) calculated by the calculation means. 

In a preferred embodiment, the apparatus further 
comprises 

storage means for storing the predetermined 
20 position coordinates (X,Y,Z) calculated by the 

calculation means as first position coordinates, and 

difference calculation means for calculating 
differences between the first coordinate values (X,Y,Z) 
stored in the storage means and position coordinates 
25 (X,Y,Z) calculated by the calculation means later as 
the coordinate input pointing tool moves, and 
when the determination result of the 
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determination means Indicates that the predetermined 
switch Is not In the operative state, and the 
comparison result of the comparison means Indicates 
that the Z- coordinate value is not less than the 
5 predetermined value, the control means outputs the 

differential coordinate values (X,y,Z) obtained by the 
difference calculation means. 

In a preferred embodiment, the apparatus further 
comprises continuous Input state determination means 
10 for determining on the basis of a coordinate 

calculation sampling rate of the calculation means 
whether input by the coordinate input pointing tool is 
in a continuous input state, and 

the predetermined position coordinates are first 
15 coordinate values of effective coordinate values during 
the continuous input state based on the determination 
result of the continuous input state determination 
means . 

In a preferred embodiment, when the determination 
20 result of the determination means indicates that the 

predetermined switch Is in the operative state, and the 
comparison result of the comparison means indicates 
that the coordinate value equals the predetermined 
value, the control means does not output the position 
25 coordinates (X,Y,Z) calculated by the calculation 
means . 

According to the present invention, the foregoing 
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object is attained by providing a coordinate input 
pointing tool of a coordinate input apparatus having a 
coordinate input surface on which an X-Y plane and a 
Z-cLxis with respect to the X-Y plane are defined, 
5 comprising: 

a first switch which is arranged at a distal end 
portion and can be pressed; 

at least two, second and third switches which are 
arranged on a housing of the coordinate input pointing 
10 tool; and 

production means for producing a first control 
signal when at least one of the second and third 
switches is in an operative state and producing a 
second control signal when both of the second and third 
15 switches are in the operative state. 

In a preferred embodiment, the production means 
produces the first control signal when the first switch 
is in the operative state. 

In a preferred embodiment, the second and third 
20 switches are arranged adjacent to each other in 
parallel to an axis of the housing. 

In a preferred embodiment, the second and third 
switches are arranged adjacent to each other along an 
axis of the housing. 
25 According to the present invention, the foregoing 

object is attained by providing a control method of a 
coordinate input apparatus which calculates position 
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coordinates of a coordinate input pointing tool with 
respect to a coordinate input surface, comprising: 

a calculation step of calculating the position 
coordinates of the coordinate input pointing tool; 
5 a change step of changing the position 

coordinates on the basis of predetermined coordinates 
related to a distance between the coordinate input 
surface and the coordinate input pointing tool; and 

an output step of outputting the position 
10 coordinates changed in the change step. 

According to the present invention, the foregoing 
object is attained by providing a control method of a 
coordinate input apparatus which calculates position 
coordinates of a coordinate input pointing tool with 
15 respect to a coordinate input surface on which an X-Y 
plane and a Z-axis with respect to the X-Y plane are 
defined, comprising: 

a calculation step of calculating the position 
coordinates (X,Y,Z) of the coordinate input pointing 
20 tool; 

a determination step of determining an operative 
state of a predetermined switch of the coordinate input 
pointing tool; 

a comparison step of comparing a predetermined 
25 value with a 2 -coordinate value of the (X,Y,Z) 

coordinate values calculated in the calculation step, 
on the basis of a determination result in the 
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determination step; and 

a control step of controlling output of the 
position coordinates (X,Y,Z) calculated in the 
calculation step, on the basis of the determination 
5 result in the determination step or the determination 
result in the determination step and a comparison 
result in the comparison step. 

According to the present invention, the foregoing 
object is attained by providing a progreun which causes 
10 a computer to control a coordinate input apparatus 

which calculates position coordinates of a coordinate 
input pointing tool with respect to a coordinate input 
surface , comprising: 

a program code for a calculation step of 
15 calculating the position coordinates of the coordinate 
input pointing tool; 

a program code for a change step of changing the 
position coordinates on the basis of predetermined 
coordinates related to a distance between the 
20 coordinate input surface and the coordinate input 
pointing tool; and 

a program code for an output step of outputting 
the position coordinates changed in the change step. 

According to the present invention, the foregoing 
25 object is attained by providing a program which causes 
a computer to control a coordinate input apparatus 
which calculates position coordinates of a coordinate 
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input pointing tool with respect to a coordinate input 
surface on which an X-Y plane and a Z-axis with respect 
to the X~Y plane are defined, comprising: 

a program code for a calculation step of 
5 calculating the position coordinates (X,Y,Z) of the 
coordinate input pointing tool; 

a program code for a determination step of 
determining an operative state of a predetermined 
switch of the coordinate input pointing tool; 

10 a program code for a comparison step of comparing 

a predetermined value with a Z- coordinate value of the 
(X,Y,Z) coordinate values calculated in the calculation 
step, on the basis of a determination result in the 
determination step; and 

15 a program code for a control step of controlling 

output of the position coordinates (X,Y,Z) calculated 
in the calculation step, on the basis of the 
determination result in the determination step or the 
determination result in the determination step and a 

20 comparison result in the comparison step. 

Other features and advantages of the present 
invention will be apparent from the following 
description taken in conjunction with the accompanying 
drawings, in which like reference characters designate 

25 the same or similar parts throughout the figures 
thereof . 



- 13 - 



BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a schematic view of a coordinate input 
system using a coordinate input apparatus according to 
each embodiment of the present invention; 
5 Figs* 2A and 2B are views showing the structure 

of a coordinate input pen of the coordinate input 
apparatus according to the first embodiment of the 
present invention ; 

Fig. 3 is a block diagreun showing the functional 
10 arrangement of the coordinate input apparatus according 
to the first embodiment of the present invention; 

Fig. 4 is a view showing an input example when 
the cursor on the screen is displayed in the first 
embodiment of the present invention; 
15 Fig. 5 is a view for explaining a coordinate 

system enlargement operation of the coordinate input 
apparatus according to the first embodiment of the 
present invention ; 

Fig. 6 is a view showing the schematic 
20 arrangement of the coordinate input apparatus according 
to the first embodiment of the present invention, which 
can measure three-dimensional (spatial) coordinates; 

Fig. 7 is a timing chart for explaining a sonic 
wave arrival time detection method according to the 
25 first embodiment of the present invention; 

Fig. 8 is a block diagram of a detection circuit 
which realizes sonic wave arrival time detection 
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according to the first embodiment of the present 
invention; 

Fig. 9 is a block diagram showing the schematic 
arrangement of an arithmetic control circuit according 
5 to the first embodiment of the present invention; 

Fig, 10 is a timing chart for explaining another 
sonic wave arrival time detection method according to 
the first embodiment of the present invention; 

Fig. 11 is a block diagram of a detection circuit 
10 which realizes another sonic wave arrival time 

detection according to the first embodiment of the 
present invention ; 

Fig. 12 is a view for explaining the coordinate 
system according to the first embodiment of the present 
15 invention; 

Fig. 13 is a table for explaining the operation 
modes of the coordinate input pen according to the 
first embodiment of the present invention; 

Fig. 14 is a flow chart for explaining the 
20 operation of the coordinate input pen according to the 
first embodiment of the present invention; 

Fig. 15 is a flow chart for explaining the 
operation of the coordinate input apparatus according 
to the first embodiment of the present invention; 
25 Fig. 16 is a table for explaining the operation 

modes of a coordinate input pen according to the second 
embodiment of the present invention; 
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Fig. 17 is a £low chart for explaining the 
operation of the coordinate input pen according to the 
second embodiment of the present invention; 

Fig, 18 is a view showing the structure of 
5 another coordinate input pen according to the second 
embodiment of the present invention; 

Fig, 19 is a view for explaining an operation 
example of the coordinate input pen according to the 
second embodiment of the present invention; 
io Fig. 20 is a flow chart for explaining the 

operation of a coordinate input apparatus according to 
the second embodiment of the present invention; 

Fig. 21 is a timing chart for explaining a sonic 
wave arrival time detection method according to the 
15 second embodiment of the present invention; 

Fig. 22 is a block diagram of a detection circuit 
which realizes sonic wave arrival time detection 
according to the second embodiment of the present 
invention; 

20 Fig. 23 is a flow chart for explaining the 

operation of a coordinate input apparatus according to 
the third embodiment of the present invention; and 

Fig. 24 is a table for explaining the operation 
modes of a coordinate input pen according to the third 

25 embodiment of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
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The preferred embodiments of the present 
invention will be described below in detail with 
reference to the accompanying drawings. 
< First Embodiment > 
5 <Descrlption of System Configuration (Fig. 1)> 

Fig. 1 is a schematic view of a coordinate input 
system using a coordinate input apparatus according to 
each embodiment of the present invention. 

The coordinate input system shown in Fig. 1 is 
10 constituted by incorporating a coordinate input 

apparatus in a rear projection display apparatus 101. 

This coordinate input system is a coordinate 
input /output Integrated system. Various kinds of 
information output from a computer connected to the 
15 coordinate input apparatus are displayed on a screen 
102 of the rear projection display apparatus 101. A 
coordinate input pen 4 serving as a pointing tool can 
input coordinate data by directly touching the screen 
102. 

20 The coordinate data can be used for icon 

operation (computer operation) or as cursor movement or 
graphic drawing (cursor locus). 

The coordinate input apparatus calculates the 
position of the coordinate input pen 4 and sends 

25 coordinate data to the computer. The computer feeds 

back the coordinate data to the screen 102 of the rear 
projection display apparatus 101. In the coordinate 
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input system, the coordinate input pen 4 can operate 
the computer by not only pointing the screen 102 but 
also performing remote control from a position 
separated from the screen 102. 
5 The screen 102 of the rear projection display 

apparatus 101 displays window information (e.g., a 
window 103) generated by the computer. As described 
above, the operator can input coordinate data by 
directly touching the screen 102 with the coordinate 
10 input pen 4. He/she can also input coordinate data 

from a position separated from the screen 102, as shown 
in Fig. 1. 

A virtual coordinate system {X,y,Z) is formed at 
the operation position of the operator. Assume that a 

15 locus 106 is virtually drawn on a schematically defined 
X-Y plane 105. In this case, a line 104 corresponding 
to the locus 106 of the coordinate input pen 4 operated 
by the operator is displayed in the window 103 on the 
screen 102 of the rear projection display apparatus 

20 101. 

As described above, in the coordinate input 
system of the present invention, even when the operator 
is separated from the screen 102 at a meeting or the 
like, he/she can operate the computer or edit the 
25 display contents by remote control. 

<Description of Arrangement of Coordinate Input 
Apparatus (Figs. 2 and 3)> 
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As described above, when an arbitrary point on a 
coordinate input surface is pointed with a pen type 
pointing tool, a coordinate input apparatus detects the 
coordinates of the input point and outputs the 
5 coordinate data to a computer connected to the 

apparatus . In this embodiment , a case wherein an 
ultrasonic type coordinate input apparatus is 
constituted as a coordinate input apparatus will be 
described. 

10 Figs. 2A and 2B are views showing the structure 

of the coordinate input pen of the coordinate input 
apparatus according to the first embodiment of the 
present invention . 

Especially, Fig. 2A is a view showing the outer 

15 appearance of the coordinate input pen 4. Fig, 2B is a 
view showing the functional arrangement of the 
coordinate input pen 4. 

When the pen point of the coordinate input pen 4 
is pressed against the screen 102, a pen point switch 

20 41 is turned on to start oscillating an ultrasonic 

wave. In remote control, when a pen side switch 42a or 
42b is pressed, oscillation of an ultrasonic wave 
starts . 

More specifically, a sonic wave generation source 
25 43 incorporated in the coordinate input pen 4 is driven 
by a pen power supply 45, a timer, an oscillation 
circuit, and a driving circuit 44 constituted by a 
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control circuit which executes control by detecting a 
plurality of pieces of switch Information of the 
coordinate Input pen 4 and a memory which stores 
various kinds of data. 
5 The sonic wave generation source 43 Is 

constituted by a piezoelectric element made of, e.g., 
PVDF (polyvlnylidene fluoride). The PVDF has an 
annular film shape having a predetermined size and Is 
designed to maximize the driving efficiency at a 

10 desired frequency. 

The driving signal for the sonic wave generation 
source 43 is a pulse signal which is generated by the 
timer and has a predetermined repetitive period. The 
pulse signal is amplified by an oscillation circuit at 

15 a predetermined gain and then applied to the sonic wave 
generation source 43. This electrical driving signal 
is converted into a mechanical vibration by the sonic 
wave generation source 43 so that its energy is 
radiated into the air. 

20 The coordinate input pen 4 according to the first 

embodiment comprises the pen point switch (SW) 41 which 
operates when the pen point is pressed, and the 
plurality of pen side switches (SW) 42a and 42b 
arranged on the housing of the coordinate input pen 4. 

25 The driving circuit 44 outputs the signal that 

drives the sonic wave generation source 43 in the 
coordinate input pen 4 at a predetermined period (e.g.. 
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every 10 msec; in this case, since a sonic wave is 
radiated 100 times per sec, the coordinate calculation 
seunpling rate of the coordinate input apparatus is 100 
times/sec) so that a sonic wave is radiated into the 
5 air. 

An infrared LED 46 generates infrared light. 
This will be described in detail in the second 
embodiment . 

Fig. 3 is a block diagram showing the functional 

10 arrangement of the coordinate input apparatus according 
to the first embodiment of the present invention. 

An ultrasonic wave signal oscillated from the 
sonic wave generation source 43 in the coordinate input 
pen 4 is detected by a plurality of ultrasonic wave 

15 sensors 305 of internal circuits of a coordinate input 
apparatus main body 304. The detected ultrasonic wave 
signal is amplified to a predetermined level by a 
waveform processing circuit 306 and input to a CPU 307 
as a detection timing signal. 

20 When all timing signals thus detected by the 

plurality of ultrasonic wave sensors are received, the 
CPU 307 converts the time information into distance 
information and calculates the coordinate position of 
the coordinate input pen 4 on the basis of the 

25 principle of triangulation . 

This coordinate calculation is executed by 
causing the CPU 307 to read out a coordinate 
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calculation program 308 stored In a ROM 312. The 
calculated coordinate data is stored in a memory 310. 
The coordinate data is also sequentially transferred to 
an external computer through a radio interface 311. A 
5 locus obtained from the coordinate data can be 

subjected to character recognition by a character 
recognition engine 309, as needed. The recognition 
result can be stored in the memory 310 as a command or 
text data. 

10 The coordinate input system according to the 

first embodiment can employ various configurations in 
addition to the above -described configuration. For 
example, the pointing tool is not limited to a pen type 
tool and may have a so-called pointing stick shape. 

15 The coordinate input scheme is not limited to the 

ultrasonic wave scheme. An infrared scheme, resistive 
film scheme, electromagnetic induction scheme, or 
electrostatic coupling scheme can also be employed. 

If the coordinate input apparatus calculates not 

20 three-dimensional coordinates along the X- , Y-, and 
Z-axes but two-dimensional coordinates, unlike the 
first embodiment, the present invention can be applied 
to the apparatus by adding a function of calculating 
the distance (coordinates related to the distance) 

25 between the screen and the coordinate input apparatus, 
and for example, a function of measuring the distance 
using infrared reflected light. 
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The display apparatus is not limited to the rear 
projection display apparatus. Any other display 
apparatus such as a front projection display apparatus, 
a liquid crystal display, or a plasma display, which 
5 can display computer information, can be used. 

The coordinate input apparatus 304 and external 
computer can be connected not by the radio interface 
311 but a wired interface. 

<Description of Operation of Coordinate Input Apparatus 
10 (Figs. 4 and 5)> 

The input method of the coordinate input 

apparatus according to the first embodiment will be 

described below on the basis of input examples by the 

coordinate input pen 4. 
15 Fig. 4 is a view showing an input excunple in 

which the cursor 104 is displayed on the screen 102 

according to the first embodiment of the present 

invention. 

In this example, the operator wants to draw a 
20 line from a point A to a point B (a line is drawn by 
transmitting coordinate information and switch 
information to the computer, like when a mouse is moved 
while keeping the left mouse button pressed) . The 
operation of the pen side switch 42a or 42b of the 
25 coordinate input pen 4, the state (ultrasonic wave 
oscillation state or stop state) of the coordinate 
input pen 4, and the coordinate output modes of the 
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coordinate input apparatus will be described with 
reference to Fig. 4. 

Referring to Fig. 4, in state 1, the cursor 104 
is only displayed on the screen 102. None of the pen 
5 point switch 41 and pen side switches 42a and 42b of 
the coordinate input pen 4 are pressed. 

In state 2, the cursor 104 is moved to the point 
A where drawing should start. More specifically, the 
pen side switch 42a is turned on to set an ultrasonic 
10 wave oscillation mode, and the cursor 104 is moved to 
the point A. 

In state 3, the pen side switches 42a and 42b are 
turned on, and the cursor 104 is moved from the point A 
to the point B. That is, this is a drawing state. The 
15 locus of the cursor 104 is displayed on the screen 102. 

In state 4, when the cursor 104 is moved to the 
point B while displaying the locus, the pen side switch 
42b is turned off (the finger is moved off from the 
switch) . 

20 When coordinate information and switch 

information are input in this way, the computer can be 
operated as if the operator were using a mouse. 

The switch information may be transmitted to the 
main body by an infrared or radio wave. Alternatively, 

25 the switch information may be detected on the main body 
side by changing the oscillation interval between the 
switches . 
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In remote control as shown in FI9 . 1 « I.e., In 
inputting coordinate data from a position separated 
from the screen 102, the three-dimensional coordinate 
axes X, Y, and Z as shown in Fig. 1 are defined. In 
5 this case, as the distance from the screen 102 along 
the Z-axis increases, the relative size of the screen 
102 (the screen 102 to which the operator wants to 
input) viewed from the operator seems to be smaller. 

However, to input X- and Y-coordinates by remote 

10 control, the operator must input a stroke equal to the 
moving distance of the cursor 104 on the screen 102. 
The operator feels as if he/she can input a small 
stroke. If so, however, the actual moving distance of 
the cursor on the screen 102 is too small. Hence, no 

15 natural sense can be felt with the input. 

In addition, the display apparatus itself often 
has a large screen. It is not uncommon that a display 
apparatus has a large screen out of reach. If the 
stroke reflected on the screen 102 in remote control 

20 and the stroke at the input position have a 1 : 1 

relationship, it is impossible to input coordinate data 
to the screen 102. 

In the first embodiment, when remote control is 
to be performed, the X- and Y-coordinates are changed 

25 (the coordinate system is enlarged) in accordance with 
the distance between the coordinate input pen 4 and the 
Z-axis such that the stroke by the operator has a 
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natural length. 

The change of X- and Y- coordinates will be 
described below with reference to Fig. 5. 

Fig. 5 is a view for explaining the coordinate 
5 system enlargement operation of the coordinate input 
apparatus according to the first embodiment of the 
present invention . 

As shown in Fig. 5, when a graphic 502 is to be 
drawn on the X-Y coordinate system of the screen 102, 
10 the actual stroke drawn by the operator in the space in 
remote control is input as a virtual curve 501. 

More specifically, the output coordinates are 
drawn as relative coordinates from a starting point P 
(xO,yO). For the output to the screen, the relative 
15 coordinates of the virtual curve 501 are multiplied by 
a predetermined magnification kn, and resultant 
coordinates are displayed on the screen 102. 
Accordingly, the operator can execute natural drawing 
even the drawing is performed by remote control at a 
20 position separated from the screen 102. 

The magnification is determined in accordance 
with the Z-coordinate, i.e., the distance from the 
screen 102 to the input position of the coordinate 
input pen 4 by the operator. The magnification is 
25 determined by looking up a table (Fig. 13) which is set 
and stored in the memory 310 in advance. 

The curve displayed on the screen 102, which is 
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Indicated by the relative coordinate values obtained by 
enlargement by the magnification kn, may be 
discontinuous depending on the driving Interval or 
coordinate calculation sampling Interval. When, for 
5 example, the average value with respect to relative 
coordinate values by the preceding coordinate 
calculation sampling is calculated by executing 
interpolation calculation and transmitted to the 
computer, a smooth curve can be obtained. 

10 <Descriptlon of Detailed Arrangement of Coordinate 
Input Apparatus > 

The arrangement of the coordinate input apparatus 
which executes the above-described operation will be 
described in more detail. 

15 Fig. 6 is a view showing the schematic 

arrangement of the coordinate input apparatus according 
to the first embodiment of the present Invention, which 
can measure three -dimensional (spatial) coordinates. 

The coordinate input pen 4 serving as a pointing 

20 tool is designed to generate a sonic wave into the air 
in accordance with the coordinate input operation by 
the operator. The generated sonic wave is detected by 
a plurality of detection sensors 3 (in the first 
embodiment, four detection sensors 3_Sa to 3_Sd are 

25 used) and processed by a signal waveform detection 

circuit 2 by a method to be described later. Then, an 
arithmetic control circuit 1 calculates the position 
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(X,Y,Z) of the sonic wave generation source of the 
coordinate input pen 4 • 

A detection sensor 7 detects infrared light. 
This will be described in detail in the second 
5 embodiment . 

The arithmetic control circuit 1 is designed to 
be able to control the entire coordinate input 
apparatus and also move the cursor displayed on a 
display apparatus 6 through a display driving circuit 5 

10 or display/add handwritten information such as notes on 
the display apparatus 6 . 

VRien the coordinate input apparatus and display 
apparatus are combined in the above way, a man-machine 
interface capable of realizing the relationship of 

15 "paper and a pencil" can be provided. 

The sonic wave from the coordinate input pen 4, 
which arrives at and is detected by the sensors, has 
delays corresponding to the distances between the sonic 
wave generation source 43 and the detection sensors 

20 3_Sa to 3_Sd. Each of the detection sensors 3_Sa to 
3_Sd is formed from, e.g., a piezoelectric vibrator 
such as PZT which generates a thickness vibration. An 
acoustic matching layer is formed on the front surface. 
The acoustic matching layer is made of a thin layer of 

25 silicone rubber or the like. The acoustic matching 

layer can match the acoustic impedance to a gas, obtain 
a wide-band characteristic at a high sensitivity, and 



- 28 - 



transmit /receive an ultrasonic wave signal with a high 
pulse response. 

The coordinate input apparatus of this type 
basically derives the distance between the sonic wave 
5 generation source 43 of the coordinate input pen 4 and 
each of the detection sensors 3_Sa to 3_Sd on the basis 
of the product of the known sound velocity of the sonic 
wave and the arrival time of the sonic wave and 
geometrically obtains the position information of the 

10 sonic wave generation source 43 using the position 

information of each of the detection sensors 3_Sa to 
3_Sd. The arrival time detection method of detecting 
the arrival time of the sonic wave will be described 
with reference to Figs. 7 and 8. 

15 Fig. 7 is a timing chart for explaining a sonic 

wave arrival time detection method according to the 
first embodiment of the present invention. Fig. 8 is a 
block diagram of a detection circuit which realizes 
sonic wave arrival time detection according to the 

20 first embodiment of the present invention. 

Reference numeral 51 denotes a driving signal 
generated by the driving circuit 44. The driving 
circuit 44 generates the driving signal 51 and also 
produces a start signal. The start signal is 

25 transmitted to the arithmetic control circuit 1 

through, e.g., an infrared LED (not shown) incorporated 
in the coordinate input pen 4 to start a timer 12 
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(Fig. 9) in the arithmetic control circuit 1. 

A sonic wave radiated into the air is delayed in 
accordance with the distances between the sonic wave 
generation source 43 and the detection sensors 3_Sa to 
5 3__Sd and detected by the detection sensors 3_Sa to 

3_Sd, Reference numeral 53 denotes a detection signal 
detected by the detection sensors 3_Sa to 3_Sd and 
amplified to a predetermined level by a 
pre -amplification circuit 60. The detection signal 53 

10 is processed by an envelope detection circuit 61 

constituted by an absolute value circuit and a low-pass 
filter, so only an envelope 54 of the detection signal 
is extracted. 

The envelope 54 will be described with an 

15 emphasis. The sound velocity of propagation of the 

waveform is represented by a group velocity Vg. When 
the singular point of the envelope 54, e.g., the peak 
or inflection point of the envelope 54 is detected, a 
delay time tg related to the group velocity Vg is 

20 obtained. An envelope singular point detection circuit 
62 which detects the peak or inflection point of the 
envelope 54 can easily detect it using a 
differentiation circuit and zero-crossing comparator. 
In the first embodiment, second-order 

25 differentiation is executed to form a signal 55. The 
inflection point of the envelope 54 is detected with 
reference to a gate signal obtained by comparing a 
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threshold level 52 with the detection signal 53 (signal 
56). When the timer 12 which is operated by the 
above -described start signal is stopped using the 
signal 56, a group delay time Tg related to the group 
5 velocity Vg can be detected. 

Strictly speaking, the group delay time Tg 
contains the delay component of the circuit related to 
waveform processing. However, its influence is 
completely removed by a method to be described later. 

10 For the sake of simplicity, a description will be made 
here asstiming that no circuit delay time is present. 

A distance L between the sonic wave generation 
source 43 and each of the detection sensors 3_Sa to 
3_Sd can be obtained by 

15 L = Vg X Tg (1) 

To more accurately calculate the distance L, the 
sonic wave arrival time is derived from the phase 
information of the detection signal waveform. This 
will be described in detail. An extra frequency 

20 component of the output signal 53 from the detection 
sensors 3_Sa to 3_Sd is removed by a bandpass filter 
64. Then, the signal 53 is input to a Tp signal 
detection circuit 66. 

The Tp signal detection circuit 66 is constituted 

25 by a zero-crossing comparator and multivibrator. A 

signal related to the zero-crossing point of the signal 
output from the bandpass filter 64 is compared with a 
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gate signal 57 produced by a gate signal generation 
circuit 65 which compares the detection signal with the 
predetermined threshold level 52 , thereby producing a 
signal 58. 

5 Then, the signal 56 which detects the 

above « described group delay time Tg is referred to as a 
gate signal (produced by a gate signal generation 
circuit 63). A signal 59 which outputs the first 
zero-crossing point where the phase of the signal 
10 wavefonn output from the bandpass filter 64 crosses 

from, e.g., the negative side to the positive side in 
the period of the signal 56 is produced. 

When the timer 12 which is operated by the 
above-described start signal is stopped using the 
15 signal 59, a phase delay time Tp related to a phase 
velocity Vp can be detected. 

Strictly speaking, the phase delay time Tp 
contains the delay component of the circuit related to 
waveform processing. However, its influence is 
20 completely removed by a method to be described later. 
For the sake of simplicity, a description will be made 
here assuming that no circuit delay time is present. 

The distance L between the sonic wave generation 
source 43 and each of the detection sensors 3_Sa to 
25 3_Sd can be obtained by 

L = Vp X Tp (2) 
The effect of use of the gate signal 56 produced 
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by the gate signal generation circuit 63 on the basis 
of the envelope singular point detection circuit 62 
will be described. 

The signal level detected by the detection 
5 sensors 3_Sa to 3_Sd varies depending on the following 
factors . 

1) The electromechanical conversion efficiency of 
the sonic wave generation source 43 and detection 
sensors 3_Sa to 3_Sd 
10 2) The distances between the sonic wave 

generation source 43 and the detection sensors 3_Sa to 
3_Sd 

3) Environmental variations in temperature and 
humidity of the air through which the sonic wave 

15 propagates 

4) The directivity of sonic wave radiation by the 
sonic wave generation source 43, and sensitive 
directivity of the detection sensors 3_Sa to 3_Sd 

Item 1) is a factor generated by component 
20 tolerance and must sufficiently be taken into 

consideration in mass production of apparatuses. Item 
2) is related to attenuation of a sonic wave. As is 
generally well known, the signal level of a sonic wave 
that propagates through the air exponentially 
25 attenuates as the distances between the sonic wave 

generation source 43 and the detection sensors 3_Sa to 
3_Sd increase. The attenuation constant changes 
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depending on the environment represented by Item 3). 

For Item 4), since the present Invention operates 
as a coordinate Input apparatus, the posture of the 
coordinate Input pen 4 serving as a writing Instrument 
5 always changes , I.e., the pen holding angle varies 
depending on the writing operation of the operator. 
The level largely changes depending on this variation. 
In addition, even when the angles made by the 
coordinate Input pen 4 and the detection sensors 3_Sa 
10 to 3_Sd vary, the detection level varies because of the 
sensitive directivity of the detection sensors 3_Sa to 
3_Sd. 

For exeunple, assume that the detection level 
becomes lower. In this case, since the above -de scried 

15 threshold level (e.g., the signal 52) Is fixed, the 
signal 58 may change to a signal 58* at a high 
probability. That Is, even when the coordinate Input 
operation Is performed at the same position, the level 
of the detection signal 53 changes if, e.g. , the 

20 holding angle (direction) of the coordinate Input pen 4 
changes. Hence, the generation time of the gate signal 
57 depends on it. However, in the present Invention, 
the gate signal 56 based on the singular point of the 
envelope 54 is referred to. For this reason, the 

25 signal 59 can stably be obtained Independently of the 
detection signal level. 

The schematic arrangement of the arithmetic 
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control circuit 1 according to the first embodiment 
will be described next with reference to Fig. 9. 

Fig. 9 is a block diagram showing the schematic 
arrangement of the arithmetic control circuit 1 
5 according to the first embodiment of the present 
invention. 

A microcomputer 11 controls the arithmetic 
control circuit 1 and the entire coordinate input 
apparatus. The microcomputer 11 is constituted by an 

10 internal counter, a ROM which stores operation 

procedures, a RAM to be used for calculation and the 
like, and a nonvolatile memory which stores constants 
and the like . 

As described above, a start signal which 

15 synchronizes with the driving timing of the sonic wave 
generation source 43 in the coordinate input pen 4 is 
generated by the driving circuit 44 and radiated 
through the infrared LED (not shown) incorporated in 
the coordinate input pen 4 as an optical signal. When 

20 the signal is detected by a start signal detection 
circuit 17, the timer 12 (constituted by, e.g., a 
counter) in the arithmetic control circuit 1 starts. 

With this arrangement, the driving timing of the 
sonic wave generation source 43 in the coordinate input 

25 pen 4 can be synchronized with the timer 12 in the 
arithmetic control circuit 1. For this reason, the 
time required for the sonic wave generated by the sonic 
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wave generation source 43 to arrive at each of the 
detection sensors 3_Sa to 3_Sd can be measured. 

Vibration arrival timing signals (signals 59) 
from the detection sensors 3_Sa to 3_Sd, which are 
5 output from the signal waveform detection circuit 2, 
are input to latch circuits 15_a to 15_d through a 
detection signal input port 13, Each of the latch 
circuits 15_a to 15_d receives the vibration arrival 
timing signal from a corresponding one of the detection 

10 sensors 3_Sa to 3_Sd and latches the count value of the 
timer 12 at that time* 

A determination circuit 14 determines that all 
detection signals necessary for coordinate detection 
have thus been received, and outputs a signal 

15 representing it to the microcomputer 11. Upon 

receiving the signal from the determination circuit 14, 
the microcomputer 11 reads the vibration arrival times 
to the detection sensors 3_Sa to 3_Sd from the latch 
circuits 15_a to 15_d, and executes predetermined 

20 calculation to obtain the coordinate position of the 
coordinate input pen 4. 

When the calculation result is output to the 
display driving circuit 5 through an I/O port 16, for 
examples , dots can be displayed at a corresponding 

25 position on the display apparatus 6. When the 
coordinate position information is output to an 
interface circuit (not shown) through the I/O port 16, 
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the coordinate values can be output to an external 
device . 

A method of accurately obtaining the distance L 
independently of the detection signal level, as 
5 described above, will be described with reference to 
Figs. 10 and 11. 

The above -described arrival time detection method 
of detecting a sonic wave arrival time using the 
arrangement shown in Figs. 7 and 8 will be defined as a 

10 first arrival time detection method. The arrival time 
detection method of detecting a sonic wave arrival time 
using the arrangement shown in Figs. 10 and 11 will be 
defined as a second arrival time detection method. 
The arrival time detection method will be 

15 described with reference to Figs. 10 and 11. Reference 
numeral 71 denotes a driving signal generated by the 
driving circuit 44. The driving circuit 44 generates 
the driving signal 71 and also produces a start signal. 
The start signal is transmitted to the arithmetic 

20 control circuit 1 through, e.g., the infrared LED (not 
shown) incorporated in the coordinate input pen 4 to 
start the timer 12 in the arithmetic control circuit 1. 

A sonic wave radiated into the air is delayed in 
accordance with the distances between the sonic wave 

25 generation source 43 and the detection sensors 3_Sa to 
3_Sd and detected by the detection sensors 3_Sa to 
3_Sd. Reference numeral 73 denotes a detection signal 
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detected by the detection sensors 3_Sa to 3_Sd and 
amplified to a predetermined level by a 
pre-amplif ication circuit 80. The detection signal 73 
is processed by an envelope detection circuit 81 
5 constituted by an absolute value circuit and a low-pass 
filter, so only an envelope 74 of the detection signal 
is extracted. 

The envelope 74 will be described with an 
emphasis. The sound velocity of propagation of the 

10 waveform is represented by the group velocity Vg. When 
the singular point of the envelope 74, e.g., the peak 
or inflection point of the envelope 74 is detected, the 
delay time tg related to the group velocity Vg is 
obtained. An envelope singular point detection circuit 

15 82 which detects the peak or inflection point of the 
envelope 74 can easily detect it using a 
differentiation circuit and zero-crossing comparator. 

In the first embodiment, second-order 
differentiation is executed to form a signal 75. The 

20 inflection point of the envelope 74 is detected with 
reference to a gate signal obtained by comparing a 
threshold level 72 with the signal 73 (signal 76). 
When the timer 12 which is operated by the 
above -described start signal is stopped using the 

25 signal 76, a group delay time Tg related to the group 
velocity Vg can be detected by a Tg signal detection 
circuit 87. 
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Similarly, the group delay time Tg contains the 
delay component of the circuit related to waveform 
processing. However, for the sake of simplicity, a 
description will be made here assuming that no circuit 
5 delay time is present. 

The distance L between the sonic wave generation 
source 43 and each of the detection sensors 3_Sa to 
3_Sd can be obtained by equation ( 1 ) . 

An extra frequency component of the output signal 
10 73 from the detection sensors 3_Sa to 3_Sd is removed 

by a bandpass filter 84 which has a resonance frequency 
with a bandwidth adapted to a plurality of frequencies 
oscillated by the sonic wave generation source 43. 
. Then, the signal 73 is input to a Tp signal detection 
15 circuit 86. The Tp signal detection circuit 86 is 
constituted by a zero-crossing comparator and 
multivibrator. A signal related to the zero-crossing 
point of the signal output from the bandpass filter 84 
is compared with a gate signal 77 produced by a gate 
20 signal generation circuit 85 which compares the 

detection signal with the predetermined threshold 
level, thereby producing a signal 78. 

Then, a pulse signal 79 (Tp signal) which outputs 
the first zero-crossing point where the phase of the 
25 signal waveform output from the bandpass filter 84 

crosses from, e.g., the negative side to the positive 
side in the period of the signal 76 is produced. When 
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the timer 12 which is operated by the above -described 
start signal is stopped using the Tp signal 79, a phase 
delay time Tp_2 related to the phase velocity Vp can be 
detected. 

5 However, the signal 79 changes depending on the 

signal level of the signal 73, as described above. For 
example, when the signal level becomes lower, the gate 
signal generation position changes due to the gate 
signal compared with the fixed threshold value, and for 
10 exeunple, a signal 78* is obtained. However, the 

difference between the phase delay time Tp_2 and the Tp 
signal obtained by the first arrival time detection 
method is an integer multiple of the phase period of 
the detection signal waveform 73, so the two signals 
15 always have a relation given by 

Tp = Tp_2 + n X T (3) 
where n is an integer, and T is the phase period of the 
detection signal waveform and has a known value. When 
equation (3) is substituted into equation (2), and 
20 equation (1) is used, we have 

n = Int[(Vg X Tg - Vp X Tp_2)/Ap + 0.5] (4) 
where Ap is the wavelength of the sonic wave, which 
equals the product of the phase velocity Vp and a 
period T. Since the integer n is known, the distance L 
25 can be accurately derived using equations (2) and (3). 

In the above description, the signals 56 and 59 
in Fig. 7 have a time difference A . The signals 76 
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and 78 In Fig. 10 also have the time difference A. 
Since the group velocity Vg and phase velocity Vp of a 
sonic wave which propagates through the air equal, the 
time difference A has a fixed amount. Its influence is 
5 completely removed by a method to be described later, 
like the circuit delay, a description will be made here 
assuming that A = 0. 

As described above, in the second arrival time 
detection method, the phase delay time detection point 

10 is located at an earlier point of the detection signal 
waveform 53 or 73 as compared to the first arrival time 
detection method. With this arrangement, the influence 
of a reflected wave can be further reduced. 

Hence, in the first embodiment, to specify the 

15 detection point of the group delay time Tg, not the 

peak (first-order differentiation) of the envelope but 
an inflection point (second-order differentiation) 
located at an earlier point is used as a detection 
point* In addition, the detection point of the phase 

20 delay time is located at an earlier point of the 

detection signal waveform in the second arrival time 
detection method than in the first arrival time 
detection method. Hence, the above-described influence 
of a reflected wave can be reduced, and coordinates can 

25 be more accurately calculated. 

The group delay time Tg of the second arrival 
time detection method is used only in equation (4) to 
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calculate the integer n by the above -de scribed 
calculation method. In addition, integer calculation 
(corresponding to round off) is arithmetically executed 
by equation (4). No influence on the calculation 
5 result is present when the error of the group delay 
time Tg due to the influence of the reflected wave 
falls within the 1/2 period of the phase of the 
detected signal waveform (within the 1/2 wavelength) • 
Hence, the second arrival time detection method is 

10 excellent because the influence of the reflected wave 
can more effectively be removed. 

However, the first arrival time detection method 
which can detect the sonic wave arrival time using only 
the phase delay time Tp is more advantageous in terms 

15 of cost than the second arrival time detection method 
which must detect both the group delay time Tg and the 
phase delay time Tp. The arrival time detection method 
to be employed is selected in accordance with the 
specifications of the target product form. 

20 In the above-described embodiment, the detected 

time contains an electrical processing time by the 
circuits and the like in addition to the sonic wave 
arrival times from the sonic wave generation source 43 
to the detection sensors 3„Sa to 3_Sd. A method of 

25 removing an extra measurement time other than the sonic 
wave propagation time will be described here. 

The group delay time Tg and phase delay time Tp 
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latched by the latch circuit contain a group circuit 
delay time etg and phase circuit delay time etp, 
respectively. Each circuit delay time always contains 
a constant value in every time measurement. Let t* be 
5 the time measured by a given measurement circuit in 

propagation between the sonic wave generation source 43 
and the detection sensor 3, e be the circuit delay time 
in the measurement circuit, and t be the actual time 
necessary for the sonic wave for propagating between 
10 the sonic wave generation source 43 and the detection 
sensor 3. The time t* is given by 

t* = t + e (5) 
Let tini* be the time measurement value when the 
distance between the sonic wave generation source 43 
15 and the detection sensor 3 is a known distance Lini, e 
be the circuit delay time in the measurement circuit, 
and tini be the actual sonic wave propagation time. 
The time tini* is given by 

tini* = tini + e (6) 

20 Hence, 

t* - tini* t - tini (7) 
Letting V be the sound velocity of the sonic wave, we 
obtain 

V X (t* - tini*) = V X (t - tini) 
25 = V X t - Lini (8) 

Hence, the arbitrary to-be-calculated distance L 
between the sonic wave generation source 43 and the 
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detection sensor 3 is given by 

L = VXt=VX (t* - tini*) + Lini (9) 
When the above -described known distance Lini and 
the time measurement value tini* for that distance (a 
5 phase delay time Tpini* in the first arrival time 

detection method or a group delay time Tgini* and phase 
delay time Tpini* in the second arrival time detection 
method) are stored in a storage medium such as a 
nonvolatile memory in the arithmetic control circuit 1 
10 at the time of shipping or reset, an arbitrary distance 
between the sonic wave generation source 43 and the 
detection sensor 3 can be accurately calculated. 

As described above, the time difference A 
between the signals 56 and 59 in Fig. 7 or between the 
15 signals 76 and 78 in Fig. 10 has a fixed amount (the 

group velocity Vg and phase velocity Vp of a sonic wave 
which propagates through the air generally equal). 
Hence, its influence can also be removed by the above 
method . 

20 A method of obtaining the position coordinates 

{X,Y,Z) of the sonic wave generation source 43 when the 
detection sensors 3_Sa to 3_Sd are arranged in the 
coordinate system as shown in Fig. 12 will be described 
next . 

25 Let La to Ld be the distances between the sonic 

wave generation source 43 and the detection sensors 
3_Sa to 3_Sd, which are accurately obtained by the 
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above method, Xs-s be the distance between the 
detection sensors in the X direction, and Ys-s be the 
distance between the detection sensors in the Y 
direction* Then, 

Lb^ _ f ^ = Lc^ - f - ( 10 ) 



Lb^-Lc^ 



2XS-S 



(11) 



Similarly , 



y = (12) 

' 2YS-S 



,13, 

10 As described above, when the distances between at 

least three detection sensors 3 and the sonic wave 
generation source 43 are measured, the position 
(spatial) coordinates of the sonic wave generation 
source 43 can easily be obtained. In the present 

15 invention, four detection sensors 3 are used. For 
example, the distance information of the farthest 
detection sensor is not used (in this case, the signal 
output from the detection sensor 3 has the lowest 
signal level because the distance is largest). 

20 Coordinates are calculated using only the remaining 

three pieces of distance information, thereby reliably 
calculating the coordinates. 

When the distance information of the farthest 
detection sensor is used, it can be determined whether 

25 the reliability of the output coordinate values is 
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high. 

As a detailed method, for example, the coordinate 
values calculated using the pieces of distance 
information La, Lb, and Lc are equal to the coordinate 
5 values calculated using the pieces of distance 

information Lb, Lc, and Ld (calculation is done while 
changing the combination of distance information). If 
the coordinate values do not coincide, any of the 
pieces of distance information is incorrect. That is, 

10 a detection error has occurred. In this case, the 

reliability may be increased by inhibiting output of 
the coordinate values. 

The operation modes of the coordinate input 
apparatus of the present invention, which can calculate 

15 the spatial coordinates, will be described next. 

The coordinate input pen 4 according to the 
present invention comprises the pen point switch 41 and 
the two pen side SWs 42a and 42b, as shown in Fig. 2A. 
The operation modes of the SWs will be described with 

20 reference to Figs. 13 and 14. In addition, the 

operation modes on the detection circuit side (main 
body side) corresponding to the operation modes of the 
coordinate input pen 4 will be described with reference 
to Figs. 13 and 15. 

25 An operation progreun which executes processing 

shown in Fig. 14 is stored in the memory in the driving 
circuit 44 shown in Fig. 2B. The control circuit (CPU) 
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in the driving circuit 44 executes the operation 
progrcun in accordance with the operations of the pen 
point SW 41 and pen side SWs 42a and 42b. 

When the operator holds the coordinate input pen 
5 4 and presses the coordinate input surface (in this 
case, the X-Y plane (Z = 0) is set on the screen 
surface of the display apparatus 6 , as shown in 
Fig. 12), the pen point SW 41 operates. 

In the following description, input by the 

10 operation of the pen point SW 41 will be referred to as 
"pen input" • Coordinate input operation which is 
performed relatively near the display apparatus 6 when 
the pen point SW 41 is not in a direct contact with the 
surface of the display apparatus 6 and does not operate 

15 will be referred to as "proximity input". Coordinate 
input operation which is performed at a position 
separated from the display apparatus 6 will be referred 
to as "remote input". 

First, in step S102, memory clear is executed to 

20 initialize various kinds of data stored in the memory. 
In step S103, it is determined whether the pen point SW 
41 is ON. This determination is done on the basis of 
whether the operator is holding the coordinate input 
pen 4 and pressing the coordinate input surface (the 

25 X-Y plane (Z = 0) is set on the screen surface of the 
display apparatus 6 ) . 

If the pen point SW 41 is not ON in step S103 (NO 
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in step S103), the flow advances to step S112. If the 
pen point SW 41 is ON (YES in step S103), the flow 
advances to step SI 05 to set driving interval T = Tl 
(e.g., 100 times/sec). In step S106, the sonic wave 
5 generation source 43 is operated by the driving circuit 
44 at the set driving frequency and driving interval 
such that a sonic wave is radiated into the air. The 
operation at this time is the pen input mode (Mode = 1) 
in Fig. 13. 

10 In step S107, operation of detecting the state of 

the pen point SW 41 is executed to determine whether 
the pen point SW 41 is ON. If the pen point SW 41 is 
ON (YES in step S107), it is regarded that the operator 
is continuing the writing operation, and the operation 

15 of driving the sonic wave generation source 43 in step 
S106 is repeated. If the pen point SW 41 is not ON (NO 
in step S107), i.e., when the operator separates the 
coordinate input pen 4 from the coordinate input 
surface, the flow advances to step S108. 

20 In step S108, a predetermined time (e.g., 10 sec) 

is set in the timer. In step S109, driving interval T 
= Til (e.g., 50 times/sec) is set. In step SllO, the 
sonic wave generation source 43 is operated by the 
driving circuit 44 at the set driving frequency and 

25 driving interval. 

In step Sill, it is determined whether the timer 
is 0 (Timer =0). If the timer is not 0 (NO in step 
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sill), the operation in steps SllO and Sill is repeated 
until the timer becomes 0. The operation mode at this 
time is the proximity input mode (Mode = 2) shown in 
Fig. 13. The operation mode shifts to this proximity 
5 input mode when the pen point SW 41 changes from the ON 
state to the OFF state. If the timer is 0 {YES in step 
Sill), the flow returns to step S102. 

In remote input wherein the operation is 
performed at a position separated from the coordinate 

10 input surface (e.g., at a position separated from the 
screen by 400 mm or more), relative coordinate 
calculation is used in which the differential values 
between the preceding coordinate values and the current 
coordinate values are calculated. Hence, the operator 

15 first moves the cursor currently displayed on the 

screen to a desired input position (so-called mouse 
drag) and clicks on an icon or performs drawing 
operation (so-called click on the left mouse button). 

Especially in the first embodiment, the cursor is 

20 moved by pressing the pen side SW 42a shown in Fig. 2A. 
Simultaneously, the pen side SW 42b is pressed to 
realize click on an icon or drawing operation. 

If the pen point SW 41 is not ON in step S103 (NO 
in step S103), the flow advances to step S112 to 

25 determine whether the pen side SW 42a is ON. If the 
pen side SW 42a is not ON (NO in step S112), the flow 
returns to step S102. If the pen side SW 42a is ON 
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(YES in step S112), i.e., when the operator is 
operating at a position separated from the coordinate 
input surface, the flow advances to step S113* 

In step S113, it is determined whether the pen 
5 side SW 42b is ON. If the pen side SW 42b is ON (YES 
in step S113), the flow advances to step S118. If the 
pen side SW 42b is not ON (NO in step S113), the flow 
advances to step S115. In steps S112 and 8113, it is 
determined whether the remote input 1 mode (Mode =3) 

10 or remote input 2 mode (Mode = 4) in Fig. 13 is set. 

When the pen side SW 42a is ON, and the pen side 
SW 42b is OFF, it is regarded that the remote input 1 
mode (Mode = 3) is set. In step S115, driving interval 
T = T2 (e.g., 30 times/sec) is set. In step S116, the 

15 sonic wave generation source 43 is operated by the 
driving circuit 44 at the set driving frequency and 
driving interval. The flow returns to step S112. 

On the other hand, when the pen side SW 42a is 
ON, and the pen side SW 42b is ON, it is regarded that 

20 the remote input 2 mode (Mode = 4) is set. In step 

S118, driving interval T == T21 (e.g., 40 times/sec) is 
set. In step S119, the sonic wave generation source 43 
is operated by the driving circuit 44 at the set 
driving frequency and driving interval. 

25 in step S120, operation of detecting the state of 

the pen side SW 42b is executed to determine whether 
the pen side SW 42b is ON. If the pen side SW 42b is 
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ON (YES In step S120), it is regarded that the remote 
input 2 mode is continuously set, and the operation of 
driving the sonic wave generation source 43 in step 
S119 is repeated* If the pen side SW 42b is not ON (NO 
5 in step S120), the flow returns to step S102. 

When the driving intervals T in the respective 
operation modes (Mode =1 to 4) satisfy driving 
interval: Tl < Til < T21 < T2 , an efficient coordinate 
input apparatus can be constituted. 

10 More specifically, the driving interval is set in 

consideration of the speed of input by the operator, 
which decreases in an order of the pen input mode (Mode 
= 1), proximity input mode (Mode = 2), remote input 2 
mode (Mode 4), and remote input 1 mode (Mode = 3). 

15 In this case, the power consumption of the coordinate 
input pen 4 can be suppressed, resulting in an 
advantage in service life of the power supply. 

The operation on the detection circuit side (main 
body side) will be described next. Referring to 

20 Fig. 15, from the standby state in step S121, it is 

determined in step S122 whether the detection sensor 3 
detects a signal from the coordinate input pen 4. If 
no signal is detected (NO in step S122), the flow 
returns to step S121. If a signal is detected (YES in 

25 step S122), the flow advances to step S123 to calculate 
the position coordinate values (X,y,Z) of the 
coordinate input pen 4. 
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Next, In step S124, it is determined whether 
driving interval T = Tl. If T ^ Tl (NO in step S124), 
the flow advances to step S128. If T = Tl (YES in step 
S124), the flow advances to step S125 to determine 
5 whether driving interval T « Til. 

If T =^ Til (NO in step S125), the flow advances 
to step S126 to set Mode = 1 and execute the operation 
of the pen input mode. If T = Til (YES in step S125), 
the flow advances to step S127 to set Mode = 2 and 
10 execute the operation of the proximity input mode. 

In step S133, the absolute coordinate values 
(X,Y) are output. 

If T =3^ Tl in step S124, the differential values 
(relative coordinates) (Ax,Ay) from the coordinate 
15 values X and Y calculated by preceding coordinate 

calculation sampling are calculated. In step S129, the 
magnification kn corresponding to the relative 
coordinates is calculated from the table (Fig. 13) 
stored in the memory on the basis of the coordinate 
20 value calculated in step S123. 

In step S130, it is determined whether driving 
interval T = T2. If T = T2 (YES in step S130), the 
flow advances to step S131 to set Mode « 3 and execute 
the operation of the remote input 1 mode. If T =it T2 
25 (NO in step S130), the flow advances to step S132 to 
set Mode = 4 and execute the operation of the remote 
input 2 mode. 
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In step S134, relative coordinate values (knA 
X,knAY) are output. 

The operation modes and position coordinate 
output forms based on the operation modes will be 
5 described* VOien the pen point SW 41 is ON, the pen 
input mode (Mode = 1) is set. Calculated coordinate 
values are absolute coordinate values {X,Y,0). When 
the values are directly output to an external device, 
the operator can perform writing operation. 

10 The OFF state of the pen point SW 41 means at 

least that coordinate input on the X-Y plane (Z = 0) by 
the operator is not executed. Even in this case, it is 
preferably possible to execute operation of, e.g., 
moving the cursor displayed on the screen. 

15 For this purposfe, the proximity input mode (Mode 

= 2) is prepared. Hence, when the pen point SW 41 
changes from the ON state to the OFF state, coordinates 
can be input even when the pen point SW 41 is not 
pressed against the coordinate input surface (even when 

20 the pen point SW 41 is not in the ON state). 

The coordinate input apparatus of the first 
embodiment can input at a position separated from the 
coordinate input surface (X-Y plane) (i.e., Z > 0). 
When the pen side SW 42a is pressed, the remote input 1 

25 mode (Mode » 3) is set. When the pen side SWs 42a and 
42b are simultaneously pressed, the remote input 2 mode 
(Mode = 4) is set. In these modes, the cursor can be 
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moved by moving the coordinate input pen 4, and the 
moving state can be left as a record (handscript ) . 

As described above, according to the first 
embodiment, the operator can smoothly move the cursor 
5 from the current position to a desired position in the 
remote input mode. While coordinate input is executed 
continuously, the X- and Y-direction moving amounts of 
the coordinate input pen 4 are output by changing the 
coordinate values relative to the cursor moving amounts 

10 in accordance with the distance from the screen. 

Hence, the operability can be increased. In addition, 
character input and graphic drawing become possible* 
< Second Embodiment > 

In the conventional coordinate input apparatus of 

15 a resistive film type or electrostatic type, it is 

difficult to form a completely transparent input plate, 
and therefore, the image quality on the display 
apparatus is low. 

In an apparatus of an ultrasonic wave scheme 

20 which calculates coordinates by propagating an 

ultrasonic wave to a propagation medium such as a glass 
plate, the glass surface must be optically processed to 
prevent, e.g., glare of a fluorescent lamp for indoor 
use* Hence, if the image quality should be maintained, 

25 the cost inevitably largely increases. 

In an apparatus of an electromagnetic induction 
type, an electrode on a matrix is arranged on the lower 



- 54 - 



side of the display screen to transmit /receive an 
electromagnetic signal to/from an input pen. For this 
reason, when the display apparatus becomes bulky and 
thick, coordinate calculation is difficult in 
5 principle. Additionally, a large-scale coordinate 
input apparatus for the purpose of conference or 
presentation is very expensive. 

Since a large display system is employed assuming 
simultaneous watching by a large audience, a sufficient 

10 image view angle and contrast are required. Hence, 

when such a large display system and coordinate input 
apparatus are combined, it is important to make it 
possible to accurately calculate coordinates at a 
sufficiently low cost and prevent any degradation in 

15 image quality of the display apparatus. 

When a large input/output integrated system of 
this type, and briefings assuming many participants or 
the age of networking are taken into consideration, it 
is preferable that, e.g., a questioner be able to 

20 operate the screen from his/her position by remote 
control (operate the screen at a position separated 
from the display) or obtain information from the 
network, as needed, in addition to control of a 
terminal such as a personal computer by causing an 

25 operator to directly touch the screen. 

As described above, actual system use forms by an 
operator can roughly be classified into three states: a 
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pen input state wherein the operator directly touches 
the input surface on the display to leave a handscript 
or execute various kinds of operations, a proximity 
input state wherein the pointing tool is operated near 
5 the input surface on the display to move the cursor or 
the like, and a remote input state wherein the pointing 
tool is operated at a position separated from the 
display* 

In the pen input state, it is important as 
10 specifications that the handscript is faithfully 

reproduced as the operator moves the pointing tool. In 
the proximity input mode as well, the distance between 
the display as the display screen and the pointing tool 
is short. It is required to, e.g., faithfully move the 
15 cursor displayed on the display when the pointing tool 
is moved. 

In the remote input mode, however, considerably 
different specifications are required. A description 
will be made assuming, e.g., presentation in a 

20 conference room or conference hall using a laser 

pointer. First, the operator intuitively holds the 
direction of the laser pointer and irradiates the 
display screen with a laser heam to indicate a desired 
point. Normally, however, the first laser irradiation 

25 position is considerably shifted from the operator's 
desired position. 

Hence, the operator can correct the direction of 
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the laser beam while checking the position of the laser 
beam with which the screen is irradiated, thereby 
attaining the object. In other words « if this feedback 
loop (visual recognition correction of direction 
5 visual recognition) is not present, it is difficult to 
indicate the predetermined position by remote control. 

In remote control, the operator may sometimes 
operate the pointer while looking at the screen 
obliquely. 

10 More specifically, the display screen of the 

display is defined as an X-Y plane, the direction of 
the normal to the X-Y plane is defined as the Z-axis, 
and the origin is set at the central point of the 
display screen of the display. Then, the range of the 

15 display screen is represented by X ^ |Xs-s/2|, Y ^ 

|Ys-s/2|, and Z = 0 (Fig, 12). However, the pointing 
tool of the operator is located in the oblique 
direction from the display. The pointing tool is not 
always located within the range represented by X ^ 

20 IXs-s/2|, Y ^ |Ys-s/2|, and K = 0. 

That is, the pointing tool can often be located 
outside the space formed by projecting the display 
screen in the Z-axis direction. In the pen input mode 
or proximity input mode, the X- and Y-coordinate 

25 detection area can almost correspond to the size of the 
display screen of the display apparatus. However, when 
the remote control state is taken into consideration. 
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the coordinate detection area size must be larger, and 
an absolute accuracy must be guaranteed. 

In the pen input state or proximity input state, 
for example, if the cursor should be moved for a long 
5 distance diagonally from a corner to another corner on 
a wide-screen display, the object is attained by moving 
not only the hand but also the human body itself 
(including, e.g., walking or changing the posture). 
Such movement is almost allowable as human operation in 

10 handwriting on a whiteboard or the like. In the remove 
control, however, predetermined handwriting is required 
on the spot. A predetermined operation must be 
executed without moving the human body. 

To implement these operations, the coordinate 

15 input pen must have a plurality of switch means. 
Operation assignment to the switch means must be 
sufficiently taken into consideration. For excunple, 
depending on whether the operator is a right-hander or 
left-hander, a dedicated pointing tool needs to be 

20 prepared or a mechanism that allows the operator 

himself /herself to change the operation assignment to 
the switch means must be prepared. This decreases the 
convenience and operability because of the 
cumber someness of the operation or increases the cost 

25 of the apparatus. 

In the second embodiment, a coordinate input 
apparatus will be described, which provides a 
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coordinate input pen which has good operability 
independently of the operator's dominant hand, and 
implements a pen input state wherein character 
information or the like is input by pressing the 
5 coordinate input pen against the input surface, and a 
proximity input state and remote control input state 
wherein the same operation as in the pen input state 
can be performed at a position separated from the input 
surface while greatly increasing the operability. 

10 A coordinate input apparatus according to the 

second embodiment is designed to cause a coordinate 
input pen 4 shown in Fig. 6 of the first embodiment to 
generate a sonic wave into the air in accordance with 
operator's coordinate input operation and also radiate 

15 infrared light to transmit an ultrasonic wave radiation 
timing or switch information of the coordinate input 
pen 4 . 

The radiated infrared light is received by a 
photosensor 7, and the simultaneously radiated sonic 

20 wave is detected by a plurality of detection sensors 3 
and processed by a signal waveform detection circuit 2 . 
Then, the position (X,Y,Z) of the sonic wave generation 
source of the coordinate input pen 4 is calculated by 
an arithmetic control circuit 1. 

25 In the present invention, the scheme of detecting 

the position coordinates of the coordinate input pen 4 
serving as a writing instrument on the basis of the 
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ultrasonic wave transmission time is described. The 
present invention can be practiced for a coordinate 
input apparatus capable of three-dimensional (spatial) 
coordinate measurement. The coordinate calculation 
5 principle (e.g., a coordinate input apparatus which can 
execute three-dimensional measurement by an optical 
method) is not limited. 

In the coordinate input pen 4 according to the 
second embodiment, when a mechanical vibration energy 
10 is radiated from a sonic wave generation source 43, an 
optical signal is radiated through an infrared LED 46 
in synchronism with the timing of vibration energy 
radiation. 

Although not illustrated in Fig. 2A, in the 
15 second embodiment, pen side SWs 42a and 42b arranged on 
the surface of the housing of the coordinate input pen 
4 are arranged to be adjacent to each other in parallel 
to the axis of the housing. 

When a pen point SW 41 or one of the plurality of 
20 pen side SWs 42a and 42b of the coordinate input pen 4 
is turned on, both an ultrasonic wave signal and an 
optical signal are radiated at a predetermined period. 
The optical signal is synchronized with the ultrasonic 
wave radiation timing. The arithmetic control circuit 
25 1 detects the ultrasonic wave radiation timing through 
a photosensor 75 and calculates the position 
coordinates of the coordinate input pen 4 as the sonic 
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wave generation source. A signal representing the 
state (e.g., which switch is ON, or a code that 
identifies the pen) of the coordinate input pen 4 is 
multiplexed with the optical signal. 
5 A method of transmitting the information will be 

described. For example, a header portion including a 
leader portion formed from a continuous pulse train and 
a code (maker ID or the like) following the leader 
portion is output first. Then, pieces of information 

10 of a transmission data row including the pen ID and 

control signals such as the above -de scribed pen switch 
signal are sequentially output in accordance with an 
order and format defined in advance. This method is 
well known (e.g., a remote controller using infrared 

15 light), and a detailed description thereof will be 
omitted here. 

The operation modes of the SWs of the coordinate 
input pen 4 will be described next with reference to 
Figs. 16 and 17. 

20 When the operator holds the coordinate input pen 

4 and presses the coordinate input surface (in this 
case, the X-Y plane (Z = 0) is set on the screen 
surface of a display apparatus 6, as shown in Fig. 12), 
the pen point SW 41 operates. First, in step S202, it 

25 is determined whether the pen point SW 41 is ON. 

If the pen point SW 41 is not ON (NO in step 
S202), the flow advances to step S203. If the pen 
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point SW 41 Is ON (YES in step S202), the flow advances 
to step S206 to cause a driving circuit 44 to operate 
the sonic wave generation source 43 at a first 
predetermined period (e.g., 50 times/sec) such that a 
5 sonic wave (first control signal) is radiated into the 
air at the first predetermined period. 

The coordinate values calculated by the 
coordinate input apparatus of the present invention at 
this time are absolute coordinate values (X,Y,0). When 

10 the values are directly output to an external device or 
the like, the operator can perform writing operation 
(pen down state). 

The ON state of the pen point SW 41 means a state 
(pen down state) wherein the coordinate input pen 4 is 

15 located on the display apparatus 6 as the coordinate 
input surface, and the operator is going to execute 
coordinate input to input a handscript. A handscript 
is displayed on the screen faithfully in accordance 
with the handwriting operation of the operator. 

20 For example, when the pen point SW 41 is operated 

twice in a predetermined time, mouse double click 
operation is recognized by monitoring the time or 
interval of signal reception or the coordinate 
calculation timing while referring to the coordinate 

25 calculation seunpling rate of the coordinate input 
apparatus . 

On the other hand, when the pen point SW 41 is 
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not ON (NO in step S202), I.e., when the pen point SW 
41 Is OFF, it means at least a state wherein coordinate 
input on the X-Y plane (Z = 0) by the operator is not 
executed. Even in this case, it is preferably possible 
5 to execute operation of, e.g., moving the cursor 

displayed on the screen (pen up state). To implement 
this operation, the coordinate input pen 4 of the 
present invention has the pen side SWs 42a and 42b. 

In steps S203 to S205, it is determined whether 

10 the pen side SW 42a or 42b is ON. On the basis of the 
determination result, when at least one of the pen side 
SWs is ON, the flow advances to step S207 to radiate a 
sonic wave (second control signal) into the air at a 
second predetermined period (e.g., 40 times/sec) (pen 

15 up state) • 

Even at a position separated from the coordinate 
input surface, if the operator wants to move the cursor 
by moving the coordinate input pen 4 and leave the 
moving state as a record (handscript ) , he/she presses 

20 both the pen side SWs 42a and 42b. Then, the flow 

advances to step S207 to radiate a sonic wave (first 
control signal) into the air at the first predetermined 
period to set the pen down state. 

The detailed use examples assuming that the pen 

25 point SW 41 is in the OFF state, and at least one of 

the pen side SWs 42a and 42b is in the operative state 
correspond to a case wherein the operator is going to 
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control the screen at a position separated from the 
display apparatus 6 as the coordinate input surface, 
and for example, a case wherein the operator is to move 
the cursor to a desired position from a remote spot or 
5 input a handscript. 

That is, when at least one of the pen side SWs 
42a and 42b is operating, the operator can realize the 
state (pen up state) wherein the cursor displayed on 
the screen can be moved. When both of the pen side SWs 

10 42a and 42b are operating, a state (pen down state) 
wherein the movement of the cursor can be left as a 
handscript can be realized ♦ 

That is, the coordinate input apparatus is 
designed to be able to output the state of the pen (pen 

15 up state or pen down state) as information 

simultaneously when coordinates are output. Hence, a 
desired operation can be implemented on the basis of 
the information by control software or application 
software stored in an external device such as a 

20 personal computer. 

The discrimination between "at least one pen side 
switch" and "both pen side switches" is done in 
consideration of the dominant hand. Especially in the 
second embodiment, as described above, the pen side SWs 

25 42a and 42b of the coordinate input pen 4 are arranged 
to be adjacent to each other syimnetrically with respect 
to the axis of eth coordinate input pen 4 . Hence , this 



- 64 - 



same effect can be obtained by the same operation 
independently of whether the operator is a right-hander 
or left-hander. 

As another embodiment of the pen side SWs 42a and 
5 42b, when a two-stroke switch, i.e., a switch whose 
second switch is operated by pressing the key top of 
the switch is used, the scune effect as described above 
can be obtained. 

As shown in Fig. 18, when the pen side SWs 42a 

10 and 42b are arranged to be adjacent along the axis of 
the housing of the coordinate input pen 4, the effect 
as described above can be obtained. 

In addition, the operations are assigned to the 
pen side SWs 42a and 42b such that the state, "at least 

15 one pen side switch" or "both pen side switches" 
functions. Since the degree of freedom of switch 
operation for attaining the object increases in 
association with specifications unique to the size of 
the operator's hand or the like, the operability 

20 increases independently of the individual variation 
between operators. 

When three pen side switches are arranged on the 
housing to add another control signal in addition to 
the above -described operations, the effect as described 

25 above can be obtained by assigning control signals for 
operations corresponding to states "one of the three 
pen side switches", "two of the three pen side 
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switches", and "all the three pen side switches" to the 
switch means. 

As described above, the state wherein the pen 
point SW 41 is in the OFF state, and at least one of 
5 the pen side SWs 42a and 42b is in the operative state 
corresponds to a case (remote input state) wherein the 
operator is going to control the screen at a position 
separated from the display apparatus 6 as the 
coordinate input surface. 

10 The "remote input" will be examined. Even when 

remote control is performed at a position separated 
from the screen as the display screen, a desired 
position can intuitively input as the distance becomes 
short (when the distance is 0, the pen point SW 41 is 

15 pressed and set in the operative state, so the pen 
input state is set). 

Inversely, as the distance between the operator 
and the screen increases, the shift between the 
operator's desired position to be indicated and the 

20 position of the displayed cursor becomes large. The 
reason for it can easily be understood by assuming 
presentation using a laser pointer. 

More specifically, when the operator indicates a 
predetermined point from a remote spot by using a laser 

25 pointer, a quite wrong position is often indicated at 
the first laser irradiation time (first point). The 
operator can move the laser irradiation position to the 
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desired position by visually recognizing the laser 
irradiation position and correcting the direction of 
the laser pointer relatively. 

That is, the object can be attained by an action 
5 "visual recognition correction visual 

recognition". Instead of feeling that "the irradiation 
position is wrong although indication is done 
properly", the human ability (an ability for indicating 
a correct direction) can be compensated by correction 

10 operation. 

As is apparent from the above examination, in the 
remote input mode, the position of the pen at the first 
point input is no important factor. When the 
coordinate input pen 4 is moved from that position to 

15 move the cursor in correspondence with the moving 
amount, remote input can be performed with good 
operability. 

That is, when a mechanism capable of faithfully 
reproducing the moving amount and direction of the 

20 coordinate input pen 4, which are realized by human 
operation, can be obtained, information displayed on 
the screen can be controlled, and a handscript can be 
added by remote control. In addition, when this 
mechanism is used, the following advantage can be 

25 obtained. 

In presentation at a conference or the like, it 
is a presenter or a host who expedites proceedings that 
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executes pen Input or proximity input. On the other 
hand, it is listeners who are at positions separated 
from the screen and see the contents displayed on the 
screen and listen to the presentation. 
5 That is, the display screen is set at such a 

position that many listeners can see it. When a 
listener brings up a question or a suggestion for the 
contents of presentation, he/she may, e.g., display 
another information or evidence through the network or 

10 add information to the materials of the presenter a 
his/her position (the position separated from the 
display screen). 

In this case, the listener is preferably able to 
all desired operations at his/her position. This can 

15 be realized in the second embodiment. 

For example, it will be described with reference 
to Fig. 12. It is quite possible that many listeners 
are placed outside the area of the space (a rectangular 
columnar space formed about the Z-axis) formed by 

20 projecting the display area of the display apparatus 6 
in the Z-axis direction. When three-dimensional 
position coordinates are detected by operating the 
coordinate input pen 4 outside that space, the 
coordinates are located outside the area of the display 

25 screen. Hence, the cursor operation on the display 
screen cannot be implemented. 

To cope with this situation, the coordinate 
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values of the first point are stored. Subsequent 
coordinate values are output as differential values 
form the stored coordinate values • In other words, 
when the coordinate values of the first point are 
5 detected, for example, the displayed cursor is not 
moved at all. Then, when the differential values of 
the coordinate values are calculated, the cursor is 
moved by the differential amounts. 

With this arrangement, even when the coordinate 

10 input pen 4 is located outside the area of the space 
formed by projecting the display area of the display 
apparatus 6 in the Z-axis direction, a comfortable 
operation environment for the above -described remote 
control can be realized. 

15 The definition of the "coordinate values of the 

first point" will be described next. 

The coordinate input apparatus is designed to 
detect and output coordinate values at a predetermined 
period. When the coordinate calculation sampling rate 

20 (the possible number of times of coordinate calculation 
per unit time) is referred to, it can be determined 
whether coordinate input is continuously executed. 

The state wherein coordinate input is 
continuously executed is a state wherein at least one 

25 of the pen point SW 41 and pen side SWs 42a and 42b is 
in the ON state, and an ultrasonic wave is radiated 
from the coordinate input pen 4 at a predetermined 
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period. That is, when the period of the 
above -described optical signal synchronized with the 
ultrasonic wave radiation timing is counted, the state 
can be determined* 
5 The "coordinate values of the first point" mean 

coordinate values that become effective for the first 
time within the continuous period. From this point of 
time, all coordinate values in this period are compared 
with the first coordinate values, and differential 

10 values therebetween are output. 

The above-described effective "coordinate values 
of the first point" are not limited to the first point 
of the continuous coordinate input. The "coordinate 
values of the first point" mean coordinate values that 

15 become effective for the first time within the 
continuous input period - 

That is, in coordinate input apparatuses of some 
types, coordinate values input first are not so 
reliable (e.g., a coordinate input apparatus employing 

20 a coordinate detection method in which coordinate 

values are not output until the third point during the 
continuous input period, and effective coordinate 
values are output from the fourth point at which stable 
coordinate detection is possible). In this case, for 

25 exeunple, the first coordinate values (the coordinate 
values of the fourth point in the above example) that 
become effective during the continuous input period are 
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stored • 

A detailed example will be described with 
reference to Fig. 19. 

The Illustration on the left side of Fig. 19 
5 indicates an example in which the displayed cursor is 
moved from a corner position I (the current position of 
the displayed cursor) to another corner position III in 
the diagonal direction. The operator of remote control 
first operates one of the pen side SWs 42a and 42b at 

10 an arbitrary position and moves the coordinate input 
pen 4 toward III. 

The cursor moves as the moving amount and 
direction of the pointing tool from the arbitrary 
position are reproduced. Assume that the operator 

15 cannot move the cursor anymore toward III unless he/she 
"walks" or "changes his/her posture" in addition to 
movement of the arm (the cursor position is II). 

At this time, the operator cancels the pen side 
SW that has been operated so far. For example, the 

20 operator returns the coordinate input pen 4 to the 

arbitrary position described above and operates the pen 
side SW again. Since the radiation of the ultrasonic 
wave that is radiated at a predetermined period stops 
simultaneously with the cancel of the pen side SW. it 

25 can be determined that the continuously input state is 
reset . 

As described above, even when the pen side SW is 
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operated again (the position of the coordinate input 
pen 4 has moved), the cursor position remains II, When 
the operator operates the pen side SW again and moves 
the coordinate input pen 4 while visually recognizing 
5 the cursor position, the cursor can be moved toward 
III, so the object can be attained. 

The illustration on the right side of Fig. 19 
indicates an example in which a character is to be 
written. First, the cursor is moved to the desired 

10 position II in accordance with the example shown on the 
left side of Fig. 19. At this time, the pen side SW 
may be either set in the OFF state or kept in the ON 
state. The pen side SW is turned off probably when the 
character cannot be written unless the operator "walks" 

15 or "changes his/her posture" because of the character 
size. The pen side SW can be kept in the ON state 
probably when the character can be input only by moving 
the arm. 

In the former case, the "coordinate values of the 
20 first point" in inputting a character "l<^" correspond 

to the position coordinates of the coordinate input pen 
4 that indicates the position II. In the latter case, 
the "coordinate values of the first point" correspond 
to the position coordinates of the coordinate input pen 
25 4 that indicates the position I. After the cursor is 

moved to the position II, both the pen side SWs 42a and 
42b are operated (pen down state). The cursor is moved 
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to the position III by moving the coordinate input pen 
4 so that a handscript corresponding to the moving 
amount and direction of the coordinate input pen 4 is 
left on the screen. 
5 At the position III, the operator cancels one of 

the pen side SWs 42a and 42b (pen up state: since the 
remaining side SW is in the operative state, an 
ultrasonic wave signal is radiated at a predetermined 
period), moves the cursor to a position IV, operates 

10 (pen down) both the pen side SWs again, and moves the 
cursor to a position V, thereby leaving the handscript 
on the screen. 

The operator must move the cursor to the first 
position II by moving the coordinate input pen 4 while 

15 visually recognizing the cursor. However, he/she can 
input the character "V^" in accordance with the 
absolute moving amount of the coordinate input pen 4, 
i.e., by intuitively moving the hand or arm without 
visually recognizing the cursor. 

20 More specifically, when the first effective 

coordinate values during the continuous input period 
are used as a reference, coordinate values output 
during the continuous period have relative values. 
When viewed from the operator, the cursor moving amount 

25 corresponds to the movement of the hand or arm during 
that period. Hence, e.g., intuitive text input 
operation can be realized. 
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The above processing will be described with 
reference to Fig. 20. 

Fig. 20 is a flow chart for explaining the 
operation of the coordinate input apparatus according 
5 to the second smbodiment of the present invention. 

The flow chart shown in Fig. 20 operates on the 
basis of the operation mode shown in Fig. 16. 

In step S302. it is determined whether an 
effective signal as information necessary for 
10 coordinate detection is detected (in the second 

embodiment, for example, whether the ultrasonic wave 
signal radiated from the coordinate input pen 4 is 
received by the detection sensor 3 is determined, as 
will be described later). 
15 If no effective signal is detected (NO in step 

S302), a standby state is set until an effective signal 
is detected. If an effective signal is detected (YES 
in step S302), the flow advances to step S303 to 
calculate the three-dimensional position coordinate 
20 values (X,Y,Z) (absolute coordinate values) of the 
coordinate input pen 4 . 

In step S304, the state of the pen point SW 41 of 
the coordinate input pen 4, which is transmitted by an 
optical signal synchronized with the ultrasonic wave 
25 radiation timing, is determined. In this case, it is 
determined whether the pen point SW 41 is in the 
operative state, i.e., whether the pen point SW 41 is 
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pressed and set in the pen input state (ON) . 

If the pen input state is set (YES in step S304), 
the flow advances to step S3 11 to output at least 
two -axes coordinate values {X,Y) of the three -axes 
5 coordinate values (X,Y,Z) obtained in step S303, and 
for example, a handscript corresponding to the movement 
of the coordinate input pen 4 is displayed on the 
display screen. 

On the other hand, if the pen point SW 41 is not 

10 in the pen input state (NO in step S304), the flow 
advances to step S305 to compare the calculated 
coordinate value Z in the Z-axis direction with 
predetermined value 1 and determine whether the 
proximity input state is set, 

15 If the proximity input state is set, i.e.. the 

Z" coordinate value is equal to or smaller than 
predetermined value 1 (YES in step S305), the flow 
advances to step S311 to output at least two-axes 
coordinate values (X,Y) of the three -axes coordinate 

20 values {X,Y,Z) obtained in step S303. 

If the proximity input state is not set in step 
S305, i.e., the Z-coordinate value is larger than 
predetermined value 1 (NO in step S305), the flow 
advances to step S306 to compare the calculated 

25 coordinate value Z in the Z-axis direction with 

predetermined value 2 and determine whether the remote 
input state is set. If the remote input state is not 
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set, i.e., the Z-coordinate value is smaller than 
predetermined value 2 (NO in step S306), the processing 
is ended without executing any operation. 

If the remote input state is set in step S306, 
5 i.e., the Z-coordinate value is equal to or larger than 
predetermined value 2 (YES in step S306), the flow 
advances to step S307 to store, in the nonvolatile 
memory, the already calculated coordinate values (the 
coordinate values obtained in step S303) as the 

10 "coordinate values of the first point" (Xlst.Ylst). 

In step S308, for example, the reception timing 
of an optical signal (a signal synchronized with the 
ultrasonic wave radiation timing at a predetermined 
period) based on the coordinate calculation sampling 

15 rate of the coordinate input apparatus is monitored, 
thereby determining whether coordinate input is 
continuously executed. 

If coordinate input is continuously executed (YES 
in step S308), the flow advances to step S309 to 

20 calculate the absolute coordinate values (X,Y,Z}. 

Then, in step S3 10, the absolute coordinate values are 
compared with the coordinate values {Xlst,Ylst) stored 
in step S307. Relative coordinate values (Ax,Ay) as 
the differential values are output, and the flow 

25 returns to step S308. 

If coordinate input is not continuously executed 
in step S308 (NO in step S308), the nonvolatile memory 
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is released, and the processing is ended. The state 
for waiting for detection of an effective signal is set 
again in step S302. 

In the second embodiment, predetermined value 1 
5 in step S305 and predetermined value 2 in step S306 may 
be the same value or different values. For example, 
when predetermined value 1 » 100 mm and predetermined 
value 2 = 1000 mm, operation can be inhibited while the 
Z -coordinate value is 100 to 1,000 mm* The settings 

10 are appropriately done in accordance with the 
application purpose. 

As described above, when the screen surface is to 
be directly touched to input coordinates and add a 
handscript or control a personal computer, or remote 

15 control is to be perfoirmed to execute the same 

operation as described above at a position separated 
from the screen using the coordinate input apparatus, 
various kinds of switches of the coordinate input pen 4 
are assigned to operations, and some of the switches 

20 are operated to periodically radiate a sonic wave. 

Simultaneously, a signal synchronized with the sonic 
wave radiation and an optical signal which transmits 
the state (pen up/down state and pen ID number) of the 
coordinate input pen 4 are radiated. 

25 Signal processing and coordinate calculation 

principle by radiated sonic wave and optical wave will 
be described next. 
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The coordinate input apparatus according to the 
second embodiment is a system which basically obtains 
position information of the sonic wave generation 
source 43 of the coordinate input pen A, as in the 
5 first embodiments An arrival time detection method of 
detecting a sonic wave arrival time will be described 
with reference to Figs. 21 and 22. 

Fig. 21 is a timing chart for explaining a sonic 
wave arrival time detection method according to the 

10 second embodiment of the present invention. Fig. 22 is 
a block diagram of a detection circuit which realizes 
sonic wave arrival time detection according to the 
second embodiment of the present invention. 

Reference numeral 1101 denotes a driving signal 

15 for the sonic wave generation source 43, which is 

generated by the driving circuit 44. Synchronously, a 
start signal as an optical signal which transmits the 
timing information of ultrasonic wave generation from 
the infrared LED 46 is radiated. This optical signal 

20 is detected through the photosensor 7. The optical 
signal transmits to the arithmetic control circuit 1 
the ultrasonic wave generation timing or the state 
(e.g., pen up/down state) of the coordinate input pen 4 
through a frequency detection circuit 210 and control 

25 signal detection circuit 211 and starts a timer 12 
(Fig. 9) in the arithmetic control circuit 1. 

A sonic wave radiated into the air is delayed in 
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accordance with the distances between the sonic wave 
generation source 43 and detection sensors 3_Sa to 3_Sd 
and detected by the detection sensors 3_Sa to 3_Sd. 
Reference numeral 1102 denotes a detection signal 
5 detected by the detection sensors 3_Sa to 3_Sd and 
amplified to a predetermined level by a 
pre-amplif ication circuit 201. The detection signal 
1102 is processed by an envelope detection circuit 203 
to extract an envelope 1113 of a detection signal 1103. 

10 In accordance with a signal 1107 generated by a 

Tg signal detection circuit 207 on the basis of the 
envelope 1113, a delay time tg related to a group 
velocity Vg is obtained. The function of an envelope 
singular point detection circuit 206 is the same as 

15 that of the envelope singular point detection circuit 
62 of the first embodiment. 

In the second embodiment, second-order 
differentiation is executed to form a signal 1106, and 
the inflection point of the envelope 1113 is detected 

20 with reference to a gate signal obtained by comparing a 
threshold level 1104 with the detection signal 1103 
(signal 1107). 

A distance L between the sonic wave generation 
source 43 and each of the detection sensors 3_Sa to 

25 3_Sd can be obtained by equation (1) described in the 
first embodiment. 

To more accurately calculate the distance L, the 
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sonic wave arrival time Is derived from the phase 
Information of the detection signal waveform, as in the 
first embodiment. That Is, an extra frequency 
component of the output signal 1102 Is removed by a 
5 bandpass filter 208* Then, the signal 1102 Is Input to 
a Tp signal detection circuit 209* A signal 1109 
related to the zero-crossing point of a signal 1108 
output from the bandpass filter 208 is generated. 

The signal 1109 Is compared with a gate signal 

10 1105 produced by a gate signal generation circuit 205 
which compares the detection signal with the 
predetermined threshold level 1104, thereby producing a 
signal 1110 which outputs the first zero-crossing point 
where the phase of the signal waveform output from the 

15 bandpass filter 208 crosses from, e.g., the negative 
side to the positive side in the period of the gate 
signal 1105. In a similar way, a phase delay time Tp 
related to a phase velocity Vp can be detected using 
the signal 1110. 

20 Accordingly, the distance L between the sonic 

wave generation source 43 and each of the detection 
sensors 3_Sa to 3_Sd can be obtained by 

L = Vp X Tp + n X Ap (14) 
where Ap is the wavelength of the sonic wave, and n is 

25 an Integer. The second term (n X Ap) on the 

right-hand side of equation (14) means that when the 
sonic wave detection level becomes low, the level of 
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the envelope 1113 also lowers. For this reason, the 
gate signal generation period of the gate signal 1105 
generated by comparing the envelope 1113 with the 
threshold level 1104 is represented by, e.g., a signal 
5 1111. 

That is, the gate signal generation period 
depends on the signal level of the detection signal 
1102. The largest factor for the change in signal 
level is the distances between the sonic wave 

10 generation source 43 and the detection sensors 3_Sa to 
3_Sd. As is well known, the signal level exponentially 
decreases in accordance with the distance. 

Hence, although the phase delay time Tp should be 
originally detected on the basis of the signal 1110, 

15 the generation period of the gate signal 1105 may 
change due to the lower signal level, and the phase 
delay time Tp may be detected on the basis of a signal 
1112. 

The time difference between the signals 1110 and 
20 1112 corresponds to one period of the signal 1108. 

When this is converted into a distance, it corresponds 
to the wavelength of the sonic wave. That is, the 
distance L derived on the basis of the phase delay time 
Tp and phase velocity Vp contains an error 
25 corresponding to an integer multiple of the wavelength 
in accordance with the signal level. Hence, the second 
terra on the right-hand side of equation (14) is the 
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correction term. 

The distances L derived by equations (1) and (14) 
should have the same value. Hence, when equations (1) 
and (14) are used as simultaneous equations, the 
5 integer n can be obtained by 

n = Int[(Vg X Tg - Vp X Tp)/Ap + 0,5)] (15) 
Integer calculation is executed in equation (15) 
because the performance of distance calculation based 
on the group delay time Tg is lower than that of 
10 distance calculation based on the phase delay time Tp, 
and the difference between the calculations should be 
absorbed. Assume that the distance calculation based 
on the phase delay time Tp has no error. In this case, 
even when an error equal to or smaller 1/2 the 
15 wavelength is contained in the distance calculation 
based on the group delay time Tg, the calculation of 
the integer n by equation (15) is accurately executed, 
so the distance can be accurately derived by equation 
(14). 

20 The arithmetic control circuit according to the 

second embodiment corresponds to the arithmetic control 
circuit according to the first embodiment shown in 
Fig. 9. Especially, in the second embodiment, when the 
coordinate position information or the state signal 

25 (the pen up/down state or pen ID) of the coordinate 
input pen 4 is output to an interface circuit (not 
shown) through an I/O port 16, the coordinate values or 
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control signal can be output to an external device. 

In the second embodiment, the detected time 
contains an electrical processing time by the circuits 
and the like in addition to the sonic wave arrival 
5 times from the sonic wave generation source 43 to the 
detection sensors 3_Sa to 3_Sd, as described in the 
first embodiment. In this case, the method of removing 
an extra measurement time other than the sonic wave 
propagation time, which is described in the first 

10 embodiment, can be applied even in the second 

embodiment. In addition, the position coordinates 
{X,y.Z) of the sonic wave generation source 43 can also 
be obtained in accordance with the same procedures as 
described in the first embodiment. 

15 As described above, according to the second 

embodiment, coordinate output states optimum for the 
coordinate input apparatus capable of three-dimensional 
input are prepared. In each of the "pen input state", 
"proximity input state", and "remote input state", an 

20 input means with good operability can be provided at a 
low cost independently of the operator's dominant hand 
or while preventing any decrease in operability in 
accordance with the individual difference in holding 
the coordinate input pen 4 as much as possible. 

25 < Third Embodiment > 

In the second embodiment, in the pen input state, 
the pen point touches the display screen of the 
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wide- screen display, thereby inputting desired 
handscript information or operating an external device 
serving as a control apparatus. To do this, the 
coordinate input pen 4 has, at its distal end portion, 
5 the pen point SW 41 which operates upon brought into 
contact with the screen. 

That is, in handwriting, when the coordinate 
input surface is touched with the pen point, the pen 
point SW 41 is operated to allow coordinate input. For 
10 example, when the pen point SW 41 is manually operated, 
the coordinate detection state is set, as a matter of 
course . 

As a detailed example, if a listener who is 
listening to the presentation operates the pen point SW 

15 41 of the coordinate input pen 4 accidentally (for 
example, the listener unconsciously or intentionally 
operates the pen point SW 41 or unconsciously hits an 
object such as a desk with the point of the pen point 
SW 41), coordinate values different from the speeJcer's 

20 desired coordinate values are detected. 

Accordingly, handscript information desired by 
the speaker cannot be obtained, or desired control 
cannot be executed. 

In the third embodiment, as an application of the 

25 second embodiment, an arrangement will be described, 
which particularly executes processing for confirming 
the presence/absence of erroneous operation in the pen 
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input state in the coordinate input operation of the 
coordinate input apparatus. The operation of the 
coordinate input apparatus with such an arrangement 
will be described with reference to Fig. 23. 
5 Fig. 23 is a flow chart for explaining the 

operation of a coordinate input apparatus according to 
the third embodiment of the present invention. 

The s£une step numbers as In the flow chart shown 
in Fig. 20 of the second embodiment denote the same 
10 processes in the flow chart shown in Fig. 23 of the 
third embodiment, and a detailed description thereof 
will be omitted. The flow chart shown in Fig. 23 
operates on the basis of the operation mode shown in 
Fig. 24. 

15 In step S304, the state of a pen point SW 41 of a 

coordinate input pen 4, which is transmitted by an 
optical signal synchronized with the ultrasonic wave 
radiation timing, is determined. In this case, it is 
determined whether the pen point SVf 41 is in the 

20 operative state, i.e., whether the pen point SW 41 is 
pressed and set in the pen input state (ON). If the 
pen input state is set (YES in step S304), the flow 
advances to step S312 to determine whether the 
Z- coordinate value of the detected coordinate values is 

25 0. In other words, it is confirmed that the coordinate 
input pen 4 touches the coordinate input surface, and 
the pen point SW 41 is operating. 
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When Z-coordinate value = 0 in step S312 {YES in 
step S312), the flow advances to step S311 to output at 
least two -axes coordinate values (X,Y) of the 
three-axes coordinate values (X,Y,Z) obtained in step 
5 S303, and for example, a handscript corresponding to 
the movement of the coordinate input pen 4 is displayed 
on the display screen. 

If Z-coordinate value 0 (NO in step S312), it 
can be determined that the pointing tool 4 is not 

10 located on the coordinate input surface although the 
pen point SW 41 is operating (the obtained coordinate 
values are coordinate values obtained by erroneous 
operation by the operator). Hence, the processing is 
ended without outputting the coordinate values to an 

15 external device or the like. The flow returns to step 
S302 to set the state for waiting for detection of an 
effective signal. 

On the other hand, if the pen point SW 41 is not 
in the pen input state (NO in step S304), in step S315 

20 the calculated coordinate value Z in the Z-axis 

direction is compared with predetermined value 1 to 
determine whether the proximity input state is set. If 
the proximity input state is set, i.e., the 
Z-coordinate value is equal to or smaller than 

25 predetermined value 1 (YES in step S315), the flow 
advances to step S311 to output at least two-axes 
coordinate values (X,Y) of the three-axes coordinate 



- 86 - 



values (X,y,Z) obtained in step S303, 

If the proximity input state is not set in step 
S315, i.e., the 2-coordinate value is larger than 
predetermined value 1 (NO in step S315), the flow 
5 advances to step S316 to compare the calculated 
coordinate value Z in the Z-axis direction with 
predetermined value 2 and determine whether the remote 
input state is set. If the remote input state is not 
set, i.e., the Z-coordinate value is smaller than 

10 predetermined value 2 (NO in step S3 16), the processing 
is ended without executing any operation. 

If the remote input state is set in step S3 16, 
i.e., the Z -coordinate value is equal to or larger than 
predetermined value 2 (YES in step S316), the flow 

15 advances to step S307 to store, in the nonvolatile 

memory, the already calculated coordinate values as the 
"coordinate values of the first point" (Xlst,Ylst). 

As described above, according to the third 
embodiment, since the validity of the calculated 

20 coordinate values is determined, any erroneous 

operation by the operator can be prevented, so a 
convenient coordinate input apparatus can be 
constituted. 

In addition, coordinate output states optimum for 
25 the coordinate input apparatus capable of 

three-dimensional input are prepared. In each of the 
"pen input state", "proximity input state", and "remote 
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input state", an input means with good operability can 
be provided at a low cost while preventing any decrease 
in operability as much as possible. 

The embodiments have been described above in 
5 detail. The present invention may be applied to a 
system constituted by a plurality of devices or an 
apparatus comprising a single device. 

The present invention also incorporates a case 
wherein its object is achieved by supplying a software 
10 progrsim (a program corresponding to the flow charts 
illustrated in the embodiments) which implements the 
functions of the above-described embodiments to the 
system or apparatus directly or from a remote site and 
causing the computer of the system or apparatus to read 
15 out and execute the supplied program codes. 

The program codes installed in the computer to 
implement the functional processing of the present 
invention also implements the present invention by 
themselves. That is, the present invention also 
20 incorporates the computer program which implements the 
functional processing of the present invention. 

In this case, the program can employ any form 
such as an object code, a program executed by an 
interpreter, or script data to be supplied to an OS as 
25 far as the functions of the program can be obtained. 
As the recording medium for supplying the 
program, for example, a floppy disk (registered 
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trademark), hard disk, optical disk, magnetooptical 
disk, MO, CD-ROM, CD-R, CD-RW, magnetic tape, 
nonvolatile memory card, ROM, DVD (DVD-ROM or DVD-R), 
or the like can be used. 
5 As another program supply method, a client 

computer may be connected to a homepage on the Internet 
using a browser, and the computer program itself of the 
present invention or a compressed file containing an 
automatic install function may be downloaded from the 

10 homepage to a recording medium such as a hard disk. A 
program code that constitutes the program of the 
present invention may be divided into a plurality of 
files, and the files may be downloaded from different 
homepages. That is, a WWW server which causes a 

15 plurality of users to download a program file that 
causes a computer to implement the functional 
processing of the present invention is also 
incorporated in the present invention. 

The program of the present invention may be 

20 encrypted, stored in a storage medium such as a CD-ROM, 
and distributed to users. Any user who satisfies 
predetermined conditions may be allowed to download key 
information for decryption from a homepage through the 
Internet, execute the encrypted program using the key 

25 information, and install the program in the computer. 

The functions of the above -described embodiments 
are implemented not only when the readout program is 
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executed by the computer but also when the OS or the 
like, which is running on the computer, performs part 
or all of actual processing on the basis of the 
instructions of the program. 
5 The functions of the above-described embodiments 

are also implemented when the program read out from the 
storage medium is written in the memory of a function 
expansion board inserted into the computer or a 
function expansion unit connected to the computer, and 
10 the CPU of the function expansion board or function 
expansion unit performs part or all of actual 
processing on the basis of the instructions of the 
program. 

As many apparently widely different embodiments 
15 of the present invention can be made without departing 
from the spirit and scope thereof, it is to be 
understood that the invention is not limited to the 
specific embodiments thereof except as defined in the 
appended claims. 
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